What is claimed is: 



1 1 . A method of constructing a choice list of alternate versions of a recognized transcript 

2 from a speech recognition system, said method comprising: 

3 during speech recognition, generating a list of close call records, wherein each record 

4 includes histories for each of two competing partial hypotheses; 

5 initializing the close call list from at least one output of the speech recognition system; 

6 selecting one of the close call records from the list of close call records; 

7 selecting a transcript from the choice list; 

8 determining whether one of the two histories for the selected record matches a partial 

9 subhistory of the transcript from the choice list; 

10 if one of the two histories for the selected close call record matches a partial subhistory of 

1 1 the transcript, substituting the other of the two histories for the partial subhistory of the transcript 

12 to generate an alternative version of the transcript; and, 

13 adding the alternative version of the transcript to the choice list. 

1 2. The method of claim 1, further including generating a list of close call records, wherein 

2 each record includes histories for each of two competing word-ending partial hypotheses. 

1 3. The method of claim 2, further including generating a list of close call records, wherein 

2 each record includes histories for each of two competing word-ending partial hypotheses, both 

3 seeding a common word. 

1 4. The method of claim 1, further including initializing the choice list with the recognized 

2 transcript. 

1 5. The method of claim 1 , further including initializing the choice list with all active, legal 

2 word ending hypotheses. 
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1 6. The method of claim 1, further including comparing the close call record selected from 

2 the close call list against each transcript in the choice list. 

1 7. The method of claim 1, further including generating a list of close call records wherein 

2 each of the close call records includes a close call score difference between the competing 

3 hypotheses, the score difference being used to construct the choice list. 

1 8. The method of claim 7, further including computing a transcript score for each transcript 

2 in the choice list by adding the close call score difference to the transcript score of the transcript 

3 from the choice list into which the other of the two histories was substituted. 

1 9 The method of claim 8, further including adding a difference between a language model 

2 score of the new transcript and the language model score of the transcript from the choice list 

3 into which the other of the two histories was substituted. 

1 10. The method of claim 1, further including limiting the list of close call records to a preset 

2 maximum number of close call records. 

1 11. The method of claim 10, further including with each of the close call records, a close call 

2 score difference between the competitor hypothesis and the score of the globally best hypothesis 

3 at the time the close call record is added, the close call score difference being used to determine 

4 which close calls to keep if the preset number of close call records is reached. 

1 12. The method of claim 1, further including with each of the close call records, a first score 

2 and a second score, the first score being a close call score difference between the competing 

3 hypotheses, the second score being a global score difference between the competitor hypothesis 

4 and the score of a globally best hypothesis at the time the record is added, wherein the close call 

5 difference is used to construct the choice list, and the global score difference is used to determine 

6 which close calls to keep if the preset number of close call records is reached. 



BOSTON 1 846023 v3 



Page 12 of 20 



1 13. A method of constructing a list of alternate versions of a recognized transcript, said 

2 method comprising: 

3 during speech recognition, generating a list of close call records, wherein each record 

4 includes histories for each of two competing partial hypotheses that seed a common word; 

5 adding the recognized transcript to a choice list; 

6 selecting a record from the close call list; 

7 for each entry on the choice list, 

8 (a) determining whether one of the two histories for the selected record matches a 

9 partial subhistory of that entry on the choice list; 

10 (b) if one of the two histories for the selected record matches a partial subhisory of 

1 1 that entry, substituting the other of the two histories for the partial subhistory of that entry 

12 to generate an alternative version of the transcript; and, 

13 (c) adding the alternative version of the transcript to the choice list. 

1 14. The method of claim 13, further comprising: 

2 selecting another record from the close call list; and, 

3 for each entry on the choice list, repeating steps (a) (b) and (c). 

1 15. A method of constructing a list of alternate transcripts from a recognized transcript, 

2 comprising: 

3 performing speech recognition on a spoken transcripts to generate a best scoring 



4 hypothesis, wherein performing speech recognition involves at each of a plurality of different 

5 times throughout the transcript generating two partial hypotheses each seeding a common word, 

6 said two partial hypotheses including a primary hypothesis having a first score and corresponding 

7 to a primary partial history and a competing hypothesis having a second score and corresponding 

8 to a competing partial history; 

9 at each of the plurality of different times, storing a close call record, wherein said close 

10 call record includes the primary partial history, the competing partial history, and a measure of 

1 1 how close the two competing hypotheses are; and 
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after performing speech recognition, using the stored close call records to generate a 
choice list of alternative versions of the best scoring hypothesis. 



1 16. A method of constructing a list of alternate transcript from a recognized utterance, 

2 comprising 

3 generating a list of close call records, wherein each record includes history information 

4 and scoring information associated with a particular pair of partial hypotheses seeding a common 

5 word; 

6 generating one or more alternate transcripts from the list of close call records by 

7 evaluating each record in the list for a match between a partial sub-history of the recognized 

8 utterance and one of the histories stored in the record, and upon finding such a match, 

9 substituting the other of the histories stored in the record for the partial sub-history in the 

10 recognized transcript; and, 

1 1 storing the one or more alternate transcripts in a choice list. 

1 17. A method according to claim 16, further including generating additional alternate 

2 transcripts by evaluating each record in the list of close call records for a match between a partial 

3 sub-history of each alternate utterance in the choice list and one of the histories stored in the 

4 record, and upon finding a match, substituting the other of the histories stored in the record for 

5 the partial sub-history in the alternate transcript; and, 

6 storing the additional alternate transcripts in the choice list. 

1 18. A method according to claim 16, further including limiting the list of close call records to 

2 a preset maximum number of records. 

1 19. A method according to claim 16, further including storing in the close call list for each 

2 pair of partial hypotheses seeding a common word (i) a history of a first partial hypothesis, (ii) a 

3 history of a second partial hypothesis, (iii) a score difference being a difference between a score 

4 of the first partial hypothesis and a score of the second partial hypothesis, and (iv) a global score 
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5 difference being a difference between the current best overall scoring hypothesis and the score of 

6 the second partial hypothesis. 



1 20. A method of constructing a list of alternate transcripts from a recognized transcript, 

2 comprising: 

3 providing two or more partial hypotheses of an acoustic transcript; 

4 for each pair of partial hypotheses characterized by a first partial hypothesis having an 

5 associated first score and a second partial hypothesis having an associated second score being 



6 less than the first score, both ending at a common time and both seeding a common continuation 

7 word, evaluating the first partial hypothesis and the second partial hypothesis at each acoustic 

8 frame following the seeding of the common continuation word, and storing in a close call list a 

9 record of the first and second partial hypotheses, the record corresponding to the acoustic frame 

10 resulting in a smallest score difference between a current best overall scoring hypothesis and the 

1 1 second score, wherein the record includes at least (i) a history of the first partial hypothesis, (ii) a 

12 history of the second partial hypothesis, (iii) a score difference being a difference between the 



13 first score and the second score, and (iv) a global score difference being a difference between the 

14 current best overall scoring hypothesis and the second score; and, 

15 generating one or more alternate hypotheses by combining information from at least one 

16 record in the close call list with the recognized transcript. 

1 21 . A method of constructing a list of alternate utterance hypotheses from a complete 

2 utterance hypothesis, comprising: 

3 providing two or more partial hypotheses of an acoustic utterance; 

4 for each pair of partial hypotheses characterized by a first partial hypothesis having an 

5 associated first score and a second partial hypothesis having an associated second score being 

6 less than the first score, both ending at a common time and both seeding a common continuation 

7 word, evaluating the first partial hypothesis and the second partial hypothesis at each acoustic 

8 frame following the seeding of the common continuation word, and storing in a close call list a 

9 record of the first and second partial hypotheses, the record corresponding to the acoustic frame 
10 resulting in a smallest score difference between a current best overall scoring hypothesis and the 
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1 1 second score, wherein the record includes at least (i) a history of the first partial hypothesis, (ii) a 

12 history of the second partial hypothesis, (iii) a score difference being a difference between the 

13 first score and the second score, and (iv) a global score difference being a difference between the 

14 current best overall scoring hypothesis and the second score; 

15 for each acoustic frame, updating the two or more partial hypotheses until the acoustic 

16 utterance ends, and selecting a best scoring complete hypothesis; 

17 evaluating the records in the close call list for potential alternate utterance hypotheses, 

18 beginning with a record in the close call list having a smallest score difference and subsequently 

19 with each record in the close call list in an order of ascending score difference, by: 

20 (i) comparing a set of first words from the first hypothesis and a set of first words 

21 from one or more complete hypotheses from a choice list; 

22 (ii) if a set of first words from a history of the first partial hypothesis matches a set 

23 of first words from one or more complete hypotheses from the choice list, substituting the 

24 history of the second partial hypothesis for the history of the first partial hypothesis 

25 within the one or more complete hypotheses from the choice list so as to generate one or 

26 more alternate utterance hypotheses, and placing the alternate hypotheses in the choice 

27 list; and, 

28 (iii) continuing evaluating the records in the close call list until filling the choice 

29 list. 

1 22. A method according to claim 21, further including comparing the set of first words of the 

2 history of the first partial hypothesis to the set of words from the complete utterance hypothesis, 

3 wherein the set of words from the complete utterance hypothesis includes all of the words from 

4 the first partial hypothesis. 

1 23. A method according to claim 21, further including providing a close call list having a 

2 capacity for a preset maximum number of records. 

1 24. A method according to claim 21 , further including providing a choice list having a 

2 capacity for a finite number of alternate transcripts. 
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1 25. A method according to claim 21, further including comparing the global score of a 

2 highest ranking record remaining in the close call list with the lowest scoring hypothesis in the 

3 choice list, and generating at least one further alternate utterance hypothesis if the global score of 

4 the highest ranking record remaining in the close call list is better than the score difference 

5 between the best and worst scoring hypotheses in the choice list. 

1 26. A method of creating an alternate utterance hypothesis from a complete utterance 

2 hypothesis, comprising: 

3 for a first partial hypothesis having an associated first score and a second partial 

4 hypothesis having an associated second score being less than the first score, both ending at a 

5 common time and both seeding a common continuation word, storing information characterizing 

6 the first partial hypothesis and the second partial hypothesis at each frame following the seeding 

7 of the common continuation word, the information including at least a history of the first partial 

8 hypothesis and a history of the second partial hypothesis; 

9 comparing a set of first words from the first hypothesis and a set of first words from the 

10 complete utterance hypothesis; and, 

11 if a set of first words from the history of the first partial hypothesis matches a set of first 

12 words from the complete utterance hypothesis, substituting the history of the second partial 

13 hypothesis for the history of the first partial hypothesis within the complete utterance hypothesis. 

1 27. A method according to claim 26, further including storing information characterizing the 

2 first and second partial hypotheses that include (i) a history of the first partial hypothesis, (ii) a 

3 history of the second partial hypothesis, (iii) a score difference being a difference between the 

4 first score and the second score, and (iv) a global score difference being a difference between a 

5 globally best hypothesis and the second score. 

1 28. A method according to claim 26, further including generating the first score and the 

2 second score based at least upon input acoustic data and a set of language models. 
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1 29. A method according to claim 26, further including comparing the set of first words of the 

2 history of the first partial hypothesis to the set of words from the complete utterance hypothesis, 

3 wherein the set of words from the complete utterance hypothesis includes all of the words from 

4 the first partial hypothesis. 



1 30. A computer readable medium including stored instructions adapted for execution on a 

2 processor, comprising: 

3 instructions for generating a list of close call records, wherein each record includes 

4 history information and scoring information associated with a particular pair of partial 

5 hypotheses seeding a common word; 

6 instructions for generating one or more alternate transcripts from the list of close call 

7 records by evaluating each record in the list for a match between a partial sub-history of the 

8 recognized transcript and one of the histories stored in the record, and upon finding such a match, 

9 substituting the other of the histories stored in the record for the partial sub-history in the 

10 recognized transcript; and, 

1 1 instructions for storing the one or more alternate trancripts in a choice list. 

1 31. The computer readable medium of claim 30, wherein the medium is disposed within a 

2 mobile telephone apparatus and operates in conjunction with a user interface. 

1 32. The computer readable medium of claim 30, wherein the medium is disposed within a 

2 handheld electronic apparatus and operates in conjunction with a user interface. 

1 33. A computer readable medium including stored instructions adapted for execution on a 

2 processor, comprising: 

3 instructions for generating, during speech recognition, a close call list of close call 

4 records, wherein each record includes histories for each of two competing partial hypotheses; 

5 instructions for initializing the close call list from at least one output of the speech 

6 recognition system; 

7 instructions for selecting one of the close call records from the close call list; 
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8 instructions for selecting a transcript from the choice list; 

9 instructions for determining whether one of the two histories for the selected record 

10 matches a partial subhistory of the transcript from the choice list; 

1 1 instructions for substituting the other of the two histories for the partial subhistory of the 

12 transcript to generate an alternative version of the transcript, if one of the two histories for the 

13 selected close call record matches a partial subhistory of the transcript; and, 

14 instructions for adding the alternative version of the transcript to the choice list. 
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